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We study a pricing game in multi-hop relay networks where nodes price their services and route their traffic 
selfishly and strategically. In this game, each node (1) announces pricing functions which specify the payments it 
demands from its respective customers depending on the amount of traffic they route to it and (2) allocates the 
total traffic it receives to its service providers. The profit of a node is the difference between the revenue earned 
from servicing others and the cost of using others' services. We show that the socially optimal routing of such a 
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, game can always be induced by an equilibrium where no node can increase its profit by unilaterally changing its 

pricing functions or routing decision. On the other hand, there may also exist inefficient equilibria. We characterize 
the loss of efficiency by deriving the price of anarchy at inefficient equilibria. We show that the price of anarchy 
is finite for oligopolies with concave marginal cost functions, while it is infinite for general topologies and cost 
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I. Introduction 

It has been widely recognized that cooperation in networks formed by autonomous and selfish nodes 
cannot be achieved unless sufficient incentives are provided to the nodes. Such incentives normally take 
the form of payment or reward to the nodes if they help forward other nodes' traffic [l]-[5]. A node is 
usually willing to participate in routing only if it can charge more than the cost of servicing the transit 
traffic. While a selfish node always prices its service with the ultimate aim of maximizing its profit, it has 
to do so strategically since the customers it courts may potentially buy services from other nodes. Thus, 
there exists a trade-off in each node's pricing decision. That is, higher charges yield larger profit margins 
but risk losing market share to its competitors. 



2 

In this work, we study the game that arises from the selfish and strategic pricing behavior of relay 
nodes in a unicast multi-hop relay network consisting of one source and one destination. A node is selfish 
in the sense that maximizing its own profit is its sole objective. Being strategic means that a node is able 
to optimally design its pricing based on the anticipation of its competitors' best response to its action. 
Specifically, in this game each node is a service provider to a group of nodes (its customers), and when 
it needs to forward the traffic received from its customers, the node itself becomes a customer that uses 
the services of some other group of nodes. As a service provider, the node announces pricing functions 
which specify the payments it demands from its respective customers depending on the amount of traffic 
the customers route to the node. As a customer, the node allocates the total traffic it receives to its service 
providers in a way that minimizes the sum of its own transmission costs and the payments made to the 
service providers. Such a game can exist in both wireline and wireless networks, where communications 
consume resources and nodes are often selfish agents. When a network, especially a wireless network, 
is formed in an ad hoc manner, a node is typically aware of its neighbors only. A rational node thus 
always bases its pricing and routing decisions on the strategies adopted by its neighbors. We will show 
that such a game always has equilibria where no node can increase its profit by unilaterally changing its 
pricing functions or routing decision. Furthermore, depending on the network topology and the nodes' 
response strategy, the global routing configuration at an equilibrium may or may not be socially efficient. 
We characterize the loss of efficiency by deriving the price of anarchy at inefficient equilibria. It is found 
that the price of anarchy is finite for some link cost functions and topologies, while it is infinite for others. 

Pricing schemes were introduced into network resource allocation problems first as a means of de- 
composing a global optimization into sub-problems solved by individual agents [6]. In addition to being 
a facilitating device, pricing serves as an essential mechanism for inducing social efficiency when users 
(source nodes) selfishly choose their routes [7]. It is well known that without appropriate pricing, e.g. 
marginal cost pricing, selfish routing inevitably results in loss of efficiency, which in general can be 
arbitrarily large [8], [9]. 

When service providers are also mindful of their self interest, they will use pricing to their own advantage 
rather than to heed any social mission. With both users and service providers behaving selfishly, the 
network increasingly approximates a free market, where prices can assume a variety of functions and lead 
to direct or indirect competition among service providers. For example, pricing network services according 
to their quality helps to match each type of service with the customers that value it the most [10], [11]. By 
modelling the interaction between the service provider and the users as a Stackelberg game, [12] shows 
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that when the service provider always adopts the profit-maximizing price, its revenue per unit bandwidth 
and the net utility of each user both improve with the number of users. When multiple service providers 
are present in a network, price competition inevitably ensues [13]— [15]. It is demonstrated in [13], [14] that 
cooperation in pricing is in the best interest of service providers who jointly serve the same customers. The 
dire consequence of non-cooperation is explicitly analyzed in [15], which shows that price competition 
in parallel-serial networks can result in arbitrarily large efficiency loss. 

In this paper, we analyze the pricing game in multi-hop relay networks where a node can compete for 
traffic from multiple nodes and can allocate its received traffic to multiple nodes. Thus, in general, a node 
is both a service provider and a customer. Another distinctive feature of the game we consider is that the 
bid from each service provider to a targeted customer is a (possibly nonlinear) pricing function, which 
specifies the price contingent on the amount of service provided. Previous work on pricing games almost 
exclusively assume a constant unit price from every service provider, which in our terms means restricting 
pricing functions to be linear. It turns out that the generalization from linear to nonlinear pricing allows 
for a much richer set of possibilities in pricing games. Even in economics literature, the issue of nonlinear 
pricing is quite new and challenging [16]Q Equilibria derived from such a general framework represent 
the most fundamental outcomes of pricing games in multi-hop networks. 

We show that the socially optimal routing can always be induced by an equilibrium of the routing/pricing 
game where no node can increase its profit by unilaterally changing its pricing functions or routing 
decision. On the other hand, there also exist inefficient equilibria. In particular, we show that in an 
oligopoly routing/pricing game, inefficient equilibria are always monopolistic, i.e., a dominant relay carries 
all the flow from the source. We prove that the price of anarchy at such inefficient equilibria is equal to the 
number of relays in an oligopoly if marginal cost functions are concave. In this case, the worst inefficient 
equilibria arise with linear marginal cost functions. When marginal cost functions are convex, however, the 
price of anarchy can be arbitrarily large. Unlike the case of oligopolies, inefficiency in general multi-hop 
relay networks stems not only from dominant relays exercising monopolistic pricing power, but also from 
the myopia of dominant relays. We demonstrate that the inability of a node to gauge the impact of its 
pricing beyond its local neighborhood can lead to an infinitely large price of anarchy. 

'The nonlinear pricing game we study can be seen as a generalized menu auction [17] where each bidder offers a continuum of options 
along with their prices. 
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II. Network Model and Problem Formulation 
A. Network Traffic and Multi-hop Routing 

We consider a relay network represented by a directed graph Q = (TV, £) with one source s and one 
destination w, and a set of relays which can be used to forward traffic in a multi-hop fashion from s to 
w. The source s needs to send traffic of a fixed rate R s to w\\ which can be carried through links in 8. 

We assume that there is no direct link between s and w. That is, traffic from s has to be routed to w 
via relays in a multi-hop fashion. To make matters simple, we assume Q contains only nodes and links 
which are on the paths from s tow. Since route discovery is not a main concern of this work, we assume 
such a Q is given a priori, and is loop-free. Each node, however, needs only to be aware of its neighbors 
(predecessors, siblings, and offsprings) as specified below. 

For node i, h is a predecessor if (h,i) E S. Denote the set of z's predecessors by Vi. For any h E Vi, 
define <Sf = {j ^ i : h E Vj}. That is, <Sf is the set of nodes which share the common predecessor h with 
i. These are the nodes who compete with i for h's traffic in the pricing game to be introduced later. We 
will refer to them as siblings of i with respect to h. Finally, i is said to be an offspring of h if (h, i) E 8. 
Let the set of h's offsprings be denoted by CV The above notation is illustrated in Figured] We make a 

T>i = {g,h} 
O g = {k,i} 
O h = {i,j} 
st = {k} 
5? = {j} 

Fig. 1. Illustration of predecessors, siblings and offsprings. 

simplifying yet plausible assumption that [J heVi D Vi — 0, i.e., no node can be both a sibling and a 
predecessor of any other node. 

By our assumption on Q, s is the only node without any predecessor while w is the only node without 
any offspring. Since the pricing game to be studied can arise only if there are multiple relays competing 
for the traffic from their common predecessor, we assume in Q that every node % except w has multiple 
relays in Oi unless Oi = {w}. 

Denote the rate of flow on E S by fy. A link flow vector / = (fij)(i,j)es is a routing of the 
session traffic if it satisfies the flow conservation constraint: J2heo s f sh = ^kev w f kw = -^ s ' an( * f° r 

2 We will discuss the problem involving an elastic session in Section Ivl 
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each relay i, 

fhi = fa = r *' 

where r { denotes the incoming flow rate at i. 

B. Link Cost and Pricing Functions 

Each link has a strictly increasing and strictly convex cost function D i j(f i j), which is private information 
to i and j only. For example, Dij(fj) can represent the queuing delay incurred on with arrival rate 
fij, e.g. the average occupancy function fy/fej — /y) of an M/M/l queue with service rate Cy. As 
another example, if the links are wireless, Dij(fj) can measure the transmission power required for 
achieving rate fa. For example, if the link transmission rate fj is determined by transmission power P^ 
as = W \og{l + KP ij ) for some constants W,K > O^then P i5 = ± (2^' w - l) = Ai(/ij). which is 
strictly increasing and convex in fj. As suggested by the examples, the analytical framework presented 
above applies to both wireline and wireless networks. 

For analytical purposes, we further assume that Aj(-) is continuously differentiable with derivative 
dij(-). By previous assumptions, (%(•) is positive and strictly increasing. The socially optimal routing is 
the routing that minimizes the network cost Y^Uj)-^ij(fij)' Because link costs are strictly convex, the 
socially optimal routing is uniquely characterized by the condition that every path from s to w with 
positive AoWlI has the minimum marginal cost among all paths. For otherwise, one can reduce the total 
cost by shifting an infinitesimal amount of flow from a path with non-minimum marginal cost to a 
minimum-marginal-cost path. 

We model the source and relays as selfish agents who must pay for the costs on their outgoing links. 
While the source has to send all its traffic out, it strives to do this with the minimum cost. On the other 
hand, a relay has an incentive to forward traffic for its predecessors only if it is adequately rewarded for 
its service in the form of payment by its predecessors. The amount of payment is determined as follows. 

Suppose a node h has incoming flow of rate r h > 0. Each i E O h announces a pricingfunction P^(-) 
which specifies the payment P^(fhi) it demands should h forward traffic of rate fhi to ito For analytical 
purposes, we assume that P^{t) is continuously differentiable with derivative pf(t). Note that P^(-) 

3 Assume that with proper time or frequency scheduling, transmission on different links are non-interfering. 
4 The flow rate of a path is the minimum of the flow rates of all the links on that path. 

5 The domain of P/"(-) must contain the interval [0, r^]. And as we will see, a selfish and strategic relay i always designs P± (•) tailored 
to the total traffic r^. However, for simplicity we do not express such dependence in the notation. 
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provides h a continuum of options, namely the rate-price pairs (f hi , P^ifhi))^ After learning (P t h (-))ieo h , 
h decides on the allocation of r h and makes payments to its offsprings accordingly. 

C. Pricing Game 

We assume every node is selfish and strategic^ The source s thus always allocates the total flow R s to 
the nodes in O s so as to minimize its total cost, which includes the costs on its outgoing links and the 
payments to its offsprings. Specifically, given the pricing functions -P/(-) of i E O s , the optimal allocation 
of R s from the perspective of s is any 

Cfc)«=o.e argmin £ D si (f si ) + P*(f si ), (1) 
(/sj)e^s(-Rs) i£Q B 

where Ti{r) is defined as {(f ik )keo l > : J2 k /« = r i- 

A relay i is a predecessor to some nodes, and is an offspring to some other nodes. As a predecessor, 
it acts just like s. That is, it allocates the total incoming flow in the most cost efficient way from its own 
perspective. Thus, the traffic allocation adopted by i when it has incoming flow is any 

[fik)keOi £ argmin 

X) D ik (f ik ) + Pl(f ik ). (2) 

(/ifc)e^(ri) 

Denote the minimum value in © by -Dj(rj). Note that Di(ri) represents the minimum cost to z for 
forwarding flow of rate It is easy to show that Di(-) is continuous and increasing with piecewise 
continuous derivative denoted by G?j(-). 

As an offspring, i designs P^(-) for every h G ?j with the aim of maximizing its profit in competition 
with its siblings (discussed in depth later). It does this with the assumption that h always allocates in the 
most cost efficient way, and that r h for each h E Vi stays constant at the current value irrespective of its 
choice of P\ l [-)- While the first assumption is very reasonable, the second one requires some justification. 

Theoretically, since r h of h E Vi is the outcome of the optimal allocation by h's predecessors, it in 
general cannot stay constant if h changes its pricing functions. However, h's pricing functions presumably 
are tied to z's choice of P^{-) as the total cost to h is partly leveraged by the price charged by i. Once 

6 If i has multiple predecessors, Pi(t) for one h £ Vi is an agreement exclusively between i and h, independent of the flow rates allocated 
to i by other predecessors. Presumably, however, i designs Pi it) for all h £ Vi jointly because rt = X^g-p /w. an d i has to pay its 
offsprings to get r-j forwarded. 

7 The destination w is the only node that plays no active role in the pricing game described below. It passively accepts the flow assigned 
by its predecessors, who treat it as an offspring using a uniformly-zero pricing function. Because Q is assumed to be loop-free and provide 
directed path(s) to w from every other node, the total flow arriving at w must be equal to R s . 

8 Although not explicit from the notation, -Dj(') depends on (i J fe(*))fceO j - 
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h reacts to the change in P/ l (-) by updating its own pricing functions, r h is inevitably adjusted by h's 
predecessors. On the other hand, relays are usually too myopic to note this chain reaction since they have 
very limited knowledge of the network. Recall that we made a practical assumption that a relay is aware 
of only its predecessors, siblings and offsprings. As a result, it can at best predict the impact of its strategy 
on the traffic allocation by its predecessors, but not nodes further upstream. It is therefore reasonable for i 
to consider only the competition with its siblings for the flow their common predecessors currently have. 
We now formally define the (static) pricing game (PG) as having the following components: 

• The set of players X = ftf\{s, w}: relays in Q. 

• Strategy of player i: continuously differentiable pricing functions for all h £ T{. 

• Payoff to player i: the profit made by servicing (f^heVi- 



where the routing (f*j)(i,j)e£ is most cost efficient from the perspective of every node, i.e., Q-© 

hold for s and every relay i where r { = ^2 heV . f^. 
A pricing game is fully characterized by the tuple (Q, (D^-(-)), R s ). In the rest of the paper, we will study 
the outcome of the PG with myopic players as described above. The focus of our work is to investigate 
whether the PG has an equilibrium where no relay can increase its profit by unilaterally changing its 
pricing functions, and when an equilibrium exists, how the resulting routing compares to the socially 
optimal one. 

D. Best Response and Equilibrium 

Each player i in the PG is assumed to be myopic in the sense that it knows the pricing func- 
tions of all its competitors as well as its downstream nodes. Based on its local information Li = 



((r h , (PjWjes^he-Pi, (P^(-))fceoJ, player i anticipates a payoff T^Pi, Li) when adopting P { = (P t h (-)) heVi , 



{fhj)j<EO h is the optimal allocation of r h by h E Vi given (P^(-)) j&0h , and (f* k )k&o r is the optimal 
allocation of r* = J2 heVi fhi S iven ( P l(-))keOr 



Definition 1: A pricing function profile (P^-^heVi is a best response to local information Li if 




(3) 



where 



Fi(Pi] Li) 



max TiiQ-Li), 

\ feasible 



where Q { = {Qi{-))heVi is feasible if every component is a continuously differentiable function. 

Denote the set of best responses to Li by Bi(Li). Before we proceed, we must prove that Bj(Xj) is 
non-empty. 

Lemma 1: For any L is the set Bi(Li) is non-empty. Furthermore, Pi E B-i(Li) if and only if for all 

h E Vi and all t £ [0,r fc ], 

£?f (t) ^ £> M (t) + Pf(t) > B}(r h ) - B\{r h - t), (4) 

and 

B»(f hi )=B?(r h )-B?(r h -f hi ), (5) 

where 

and (fhi)h&p z is a vector that maximizes 



over all the f { = (f hi ) such that < f hi < r h for all h E Vi. 




Before giving the proof, we first provide some intuitive explanations for the lemma. The function B^{t) 
gives the total cost h spends on routing traffic of rate t to i. Since D hi (-) is fixed and known to i, it is 
equivalent to treat Bf{-) as the pricing function i uses to charge h. With this view, h makes a lump-sum 
payment to i determined by B^(-), and lets i pay for the cost D hi (-) on link (h, i). For convenience, from 
now on we assume each relay i announces B^(-) to h E Vi and siblings j E Sf. By ©, B?(r) represents 
the minimum cost h can achieve by forwarding traffic of rate r to offsprings other than i. It will become 
evident in the next proof that from i's viewpoint, the competition from all j E can be aggregated into 
a virtual competitor i h using pricing function B^(-). Thus, it is as if i were competing with one relay i h in 
each "market" h E Vi. The vector (fhi)heVi represents the "market shares" that jointly yield the maximum 
(anticipated) profit to i. Pricing functions -Bf(-) which satisfy the conditions in Lemma \T\ induce h E Vi 
to allocate the ideal "market share" f hi to i and give i the maximum profit. This is because © implies 
that allocating fhi to i and the rest to other relays yields the same cost to h as allocating all the traffic to 
other relays. So conditions © and © combined imply that no other allocation costs less than the above 
two schemes. 



9 



Proof of Lemma [7J- First notice that for fixed L if the profit of i when it adopts (B^(-)) heVi is upper 
bounded as follows: 



where f i = (fhi)hev t is me optimal amount of traffic allocated to i when i uses (B^(-)). The first 
inequality holds because for every h £ 7^, B^(f hi ) < B^[r h ) — B^(r h — For otherwise, ft, would 
find the cost of allocating exclusively to all j £ (Bt(rh)) strictly less than the cost of allocating 
f hi to % and r h — f hi to j £ <Sf (B^(f hi ) + B^(r h — fhi)), a contradiction. The second inequality follows 
from the definition of / \. 

Notice that the upper bound T^fi, Lf) is independent of (B^ (■)). It is tight if and only if both inequalities 
hold with equality. To make the second inequality tight, it is necessary and sufficient to have the traffic 
allocation f i induced by (B^ (•)) equal to fi. Given that, the first inequality is tight if dU)-© hold, since 
they guarantee that allocating f hi to i and r h — f hi to j £ is in h's best interest. They are also necessary 
because © is prerequisite for the first inequality to be tight, and consequently © cannot be violated either. 
For example, if for some h £ Vi and some t £ [0,r ft ], B^(t) < B^{r h ) — B^(r h — t). Then allocating t 
to i and — t to j £ <Sf would incur strictly less cost to h than B^(rh) = B^(t)(fhi) + B^(rh — fhi)- 
Thus, h would not have allocated fhi to i, which is a contradiction. □ 

Note that best response (B^ (•)) always exists because, for instance, B^(t) = B^{r h ) — B^{r h — t) for 
t £ [0,7^] satisfies ©-©. The (pure- strategy) Nash equilibria are defined as the fixed points of the best 
response mapping. 

Definition 2: Pricing function profiles Pj, % £ X constitute an equilibrium if for all i £ X, Pj £ Bi(Li) 
where the incoming flow vector (rh)heVi contained in Lj results from the routing (/y)(i,i)e£ ma t is most 
cost efficient from the perspective of every individual node, i.e., ©-© hold for s and all i £ X, 



r 4 ((itf (■));£*) 



< 




W*;^) <f<(/*;£i), 



sen 



and = R s if /i = s. 
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It is easy to see that if (Pi) ie j constitutes an equilibrium, T^P^Li) must coincide with the actual 
payoff of i. 

Definition 3: An equilibrium (Pi)iei is efficient if it induces the socially optimal routing. In this case, 
(-Pj)iex is said to induce the social optimum. 

Before proving the existence of equilibria and analyzing their efficiency in the general setting, we first 
study pricing games under some simple network topologies. The analysis of these games not only provide 
valuable insight into the general problem but also have significant implications in their own right. 

III. Equilibria in Oligopoly 

The simplest topologies within our framework are those including a single layer of relays, e.g. the one 
in Figure [2l Here, N relays each have a direct link from s and a direct link to w. They compete for the 




Fig. 2. Oligopoly with N relays. 

total flow R s by advertising their pricing functions /%(•) = d si (-) + pi(-) , i = 1, ••• ,N. From now on, 
we will more often refer to the derivatives <%(•) and Pi(-) as link cost and pricing functions, since they 
appear to be more convenient for marginal cost analysis at equilibria. Also we will use simplified notation 
whenever appropriate, e.g. the superscript is omitted from Pi(-), $(•) as s is the only predecessor to every 
relay. We refer to a pricing game under such a topology as an oligopoly. Define Aj(t) = d si (t) + di(t). 
An oligopoly PG is fully characterized by the tuple (N, (A i (-))^ 1 , R s ). 

Because all Aj(-) are strictly increasing, the socially optimal routing (r*)f =1 is unique and is given by 

H r *) = . mm Aj(r-) 

3=1,— ,N 

if r* > 0. 
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We now analyze the routing established by the oligopoly PG. Given (A('))«ee> s > the self-interest of s 
leads it to adopt the most cost efficient routing (/ s *)^! such that 

ACf*) = . min W;.) (7) 

3=1,... ,JV 

whenever / s * > 0. Whether = (r*) or not depends on how (&(■)) ^ chosen by the individual 
relays. 

A. Best Response and Existence of Equilibria 
We apply Lemma Q] to the oligopoly PG. Here, 

Biit) = [ A(r) dr, 

fs. 



o 



= „ min . X) / ^( r ) dr - 

l^j^t J si — * . , . Jo 



It is easy to show that -Bj(t) is continuous and increasing. Its derivative, denoted by is in general 

piecewise continuous. For t E (0,R S ), let the left and right limits of be denoted by Pi(t)~ and 
+ y By Lemma [H the best response of z given can be simply characterized by 

'* f > fn fc(R, -r) dr, 0<t< R s 
fr(r)dr{ ~ J l HlK (8) 

{ = f* (3.(R S - r) dr, f = /*, 
where 

rfi 

f* e argmax / (3-(R s - r) - Aj(r) dr. (9) 

0<fi<Rs Jo 

To gain an intuitive idea of the above conditions, suppose Pi(R s — r) and A,(r) are given by the dashed 
and solid curves in Figure [3l A typical best response (3i(r) is shown as the dotted curve. In particular, 



Fig. 3. Typical best response curve in oligopoly. 

one can let $(7*) coincide with Pi(R s - r) on [0, /*] and let (3i(r) > /3i(R s - r) on (f*,R s ]. Such a 
best response will be referred to as a replicating response. As we will show, oligopoly equilibria induced 
by replicating responses are always efficient while equilibria induced by other best responses are not 
necessarily efficient. 

9 It is understood that /3j(0) has only a right limit and that Pi(R a ) has only a left limit. 
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B. Efficient Equilibria 

Theorem 1: The socially optimal routing of an oligopoly can always be induced by an equilibrium. 

Proof: We prove the theorem by constructing an equilibrium that induces the socially optimal routing 
(r*). Define A* = mm j=li ... jN Xj(r*). Let #(r) = A* for all i. Then /3-(r) = f3-(R s - r) = A* is a best 
response for all i with /* = r*. Thus, (/%(•)) constitutes an equilibrium which results in the routing (r*). □ 

Because the socially optimal routing always exists, we can conclude that there always exists an efficient 
equilibrium for any oligopoly pricing game. 

Although we used constant (/%(•)) (or linear pricing functions (£>j(-))) to construct an efficient equi- 
librium in the proof, efficient equilibria can be established by nonlinear pricing functions as well. For 
instance, Figure |4] depicts an equilibrium in a duopoly PG where the two relays adopt Pi(-), /^G) of a 
more general shape. Notice that in a duopoly, = f3 2 {t) and fy(t) = fii(t). 



Fig. 4. General (focal) equilibrium in duopoly. 

To derive a simple criterion for checking the efficiency of an equilibrium, we need to make the following 
distinction. A routing (fi)fLi is said to be monopolistic if f m = R s for some relay m and fj = for 
all j ^ m. In this case, m is called the dominant relay. An equilibrium is monopolistic if it induces a 
monopolistic routing. A routing is said to be competitive if there are at least two relays i, j such that 
fi > 0, fj > 0. An equilibrium is competitive if it induces a competitive routing. 

Theorem 2: If an oligopoly equilibrium is competitive, it must be efficient. 

We will need the next lemma to prove Theorem [2l 



Lemma 2: At an oligopoly equilibrium which induces routing (/*), if < /* < R s , then for 

all j + i, 
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If < /; < R s , then for all j ^ i such that /* > 0, 

Pi(Rs-f:r>w;)- 

Proof: By definition, if t < R s , p-(t) + = \im A ^ 0+ (B-(t + A) - B t (t))/A. Therefore when /* > 0, 



(h(R s -fD + = lim + ^{B.(R s -f: + A)-B- i (R s -f:)} 



(J 

A 



Pj(r) dr 



< lim - / ft(r) dr+J2 &(r) dr - £ / ft(r) rfr 

1 



= lim - / ft(r)dr = 

Here, equation (a) follows from the fact that (f*)^ =1 is the equilibrium routing of R s induced by (/3 7 -(-))jL l . 
Inequality (b) is obtained by substituting the minimum-cost routing of R s — f* + A by an arbitrary routing, 
namely f% + A allocated to and /* to each j ^ i, k. The second inequality in the lemma can be proved 
in a similar manner. □ 



Proof of Theorem \2\- Let (/*) be the routing induced by a competitive equilibrium ($(•)). Let m,n 
be any two relays such that f* t > 0, /* > 0. It is enough to show that A m (/^J = A n (/*) and that 
A OT (/*) < Aj(/*) for any j with /* = 0. By ©, ^(/^ = The best response condition © 

implies that ^{R, - /* )~ < A m (/*) < /3 A (i? s - /* )+. By Lemma (3 n (f*) < (3^{R S - /* )~ 
and /?m(-R s - /^) + < PnUn)- In conclusion, /?„(/*) = A m (/^). By symmetry, we can show that 
A»(/m) = A n(/n*)- Therefore, A m (^) = A n (/*). Now suppose f* = 0. By © and Lemma E A,(0) > 
> &(/«) = M/m)- So the P roof is complete. □ 



C. Inefficient Equilibria 

Theorem [2] does not rule out the possibility of inefficient equilibria. In fact, an equilibrium may be 
inefficient if it is monopolistic. For example, the socially optimal routing of the duopoly PG represented 
by Figure [5] is (r*,R s — r*) whereas the equilibrium depicted leads to a monopolistic routing (R s , 0). 
In this example, relay 2 adopts a pricing function (3 2 (-) such that J^ s /3 2 (r) <ir = f Q 8 A 2 (r) dr and 
foiRs — r) > Ai(r) for all r £ [0,i? s ]. Given such a fh{'), relay 1 would want to acquire all the flow 
(cf. ®) by using (5 X (-) such that f* f3x(R 8 - r) dr < f* A 2 (r) dr and / */3i(r) dr > /3 2 (R S — r) dr for 
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Fig. 5. Inefficient equilibrium in duopoly. 



all t G (0,R S ) and f" s ^{R a - r) dr = J^ a A 2 (r) dr = f*° f3 2 {r) dr. Thus, it satisfies © and leaves 
relay 2 no incentive to acquire any traffic. So the monopolistic equilibrium holds. 
In general, monopolistic equilibria in an oligopoly PG have the following property. 

Theorem 3: If an oligopoly equilibrium is monopolistic with dominant relay m, we must have 

R s rRs 

A m (r) dr < Aj(r) dr 



for any other relay j. 

Proof: Consider any j with f* = in a monopolistic equilibrium. The condition © implies that 

Rs rRs 

Xj(r) dr> j (3-(R s -r) dr. 



JO 

On the other hand, 

n Rs pR-a pR-s 



(3-(R s -r)dr= / ^.(r) dr = / p m (r) dr, 
>o Jo Jo 

since from the perspective of s, the optimal allocation of R s to all the relays except j still assigns all the 
traffic to m. It follows from m's best response conditions ©-dH) that 

Rs rRs rRs 

f3 m {r) dr= /3^{R S - r) dr > / A m (r) dr. 
o Jo Jo 

Thus the proof is complete. □ 



The next conclusion easily follows from Theorem |3j 

Corollary 1: If the socially optimal routing of an oligopoly is monopolistic, then every equilibrium of 
the oligopoly is monopolistic and efficient. 

Proof: It can deduced from the uniqueness of the socially optimal routing and Theorem [2] that every 
equilibrium of such an oligopoly must be monopolistic. By Theorem |3j the dominant relay m of such an 
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equilibrium has the minimum A m (r) dr among all relays. But such an m must be the dominant relay 
in the socially optimal routing. □ 



It is shown next that there always exists a monopolistic equilibrium in an oligopoly. Thus, we have the 
following conclusion. 

Corollary 2: If the socially optimal routing of an oligopoly is competitive, then there exists an inefficient 
(monopolistic) equilibrium. 

Proof: We need only show that there exists a monopolistic equilibrium in such an oligopoly. Let all 
0j(-) be the same strictly decreasing function /?(•) such that J* (3(R S — r)dr < f Q Xj(r)dr for all j and 
t e [0, R s ) but J s P(R S - r)dr = f" s X m (r)dr where m G argmhx,- f Q B Xj(r)dr. Since /?(•) is strictly 
decreasing, /3j(r) = (5{r) for all j. By construction, f* = is an ideal flow to j ' ^ m (cf. ©) whereas 
Pm(-) = P(-) and = R s jointly satisfy m's best response conditions ®-([9]). So the monopolistic 
equilibrium is established. □ 



When an oligopoly has inefficient equilibria, it is of interest to compare the worst-case network cost 
under an inefficient equilibrium to the optimal cost. 

D. Price of Anarchy 

The price of anarchy, as a measure of loss of social efficiency due to selfish behavior of individual 
agents, was studied in the literature on selfish routing [8], [9]. In this work, the price of anarchy of a 
general PG is defined as follows. 

Definition 4: The price of anarchy p(Q, (Dy(-)), R s ) of a pricing game (Q, (£)y(-)), R s ) is the ratio of 
the maximum cost at an equilibrium to the socially optimal cost, i.e., 

n(r (n c\\ p \ A max (fe)^E( t j) g£ DM) 
p[y,{Dij{-)),R s ) = — , 

where T E is the collection of all routings that can be induced by an equilibrium of (Q, (Dy (•)), R s ) and 
(f*j)(i,j)e£ is the socially optimal routing of the game. 

In this section, we study the price of anarchy specifically for oligopolies. As we will show, p(N, (Aj(-)), R s 
is equal to iV when marginal cost functions are concave, e.g. when cost functions are quadratic. However, 
the price of anarchy can be arbitrarily large when when marginal cost functions are convex, as is the case 
for the cost functions discussed in Section HI-Bl 
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Theorem 4: If the cost derivatives (Aj(-)) are concave, p(N, (Xi(-)),R S ) of an oligopoly pricing game 
is upper bounded by the number of relays N. The upper bound is achieved when the cost derivatives are 
linear. 

Proof: Let the socially optimal routing be (r*)^ = where the coefficients (ctj) are nonneg- 

ative and sum to one. The optimal cost then is 

N ratR. 



d* = J2 A *( r ) dr - 

i=l J ° 



Since Aj(r) is concave, it can be shown that J^' a \i{r)dr > af f Q 3 Xi(r)dr where equality holds when 
Aj(r) is linear. Therefore, D* is lower bounded as 

N rR. 



D* > VV f S Xi(r) dr. 
i=i Jo 



Recall that inefficient equilibria in an oligopoly are monopolistic such that the dominant relay m satisfies 
Theorem [3j The price of anarchy, which is the ratio of the cost at any monopolistic equilibrium (ME) to 
D*, is upper bounded as 



D ME W J Rs A m (r) dr W J Q R ° A m (r) dr = 1 W ^ 

D * ~ EL*Uo Ra W dr ~ Eii^f^ ^(r) dr Ef =1 «f" 
Next we specify the condition under which the upper bound is achieved. Notice that (a) holds with 

equality if and only if j^ Rs \{r)dr = otf J^ s Xi(r)dr for all i. This requires each \{r) to be a linear 

function. Inequality (b) is tight when f Q s Xi(r)dr = J 3 X m (r)dr for every i ^ m. Hence, all the relays 

must have the same linear Aj(r). Thus, (r*) must be the uniform, hence competitive, allocation, i.e., 

aj = 1/N for all i. This is exactly what is needed to make (c) tight. 

Now it remains to find the pricing functions which can induce the monopolistic equilibrium attaining 

the upper bound. Let @i(r) = X(R S — r) = (3(r) for every Since i s strictly decreasing for every 

i, Pi(r) = (3{r) = X(R S — r). Since Pi(R s — r) = A(r), every relay is indifferent to having any amount of 

flow. Thus, the monopolistic equilibrium can be sustained. □ 



Unlike the selfish routing games considered in [8], [9], for which the price of anarchy is independent 
of the topology [18], Theorem |4] indicates that p(N , (Aj(-)) , R s ) of an oligopoly PG explicitly depends 
on topology through N. Such a conclusion implies that the more intensive (larger N) the competition is, 

10 Here we have omitted the subscript of Aj(-) in light of the symmetry. 
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the more inefficient the market becomes if it is monopolized. The situation is even worse if the relays in 
an oligopoly have convex Aj(-). In this case, the price of anarchy can be arbitrarily large. 



Theorem 5: For a fixed number N > 2 of relays and for any M > 0, there exists an oligopoly 

(N, (Xi(-))g v R a ) with convex (A,(-)) such that p(N, {Xi{-)),R S ) > M. 



Sketch of Proof : We can construct an oligopoly with iV relays such that the socially optimal routing is 
competitive. By Corollary [2l inefficient monopolistic equilibria exist. However, within the class of convex 
functions, A m (-) of the dominant relay in can be designed so that J^ B A m (-) > MD*, where D* is the 



E. Focal Equilibria 

Although possible, inefficient equilibria in an oligopoly are very unlikely to happen. The example in 
Figure [5] represents a highly pathological situation. Such an equilibrium is reached only if the subtle 
relationships between {3 2 {-) an d Ai(-) and between [3\{-) and A 2 (-) are satisfied. These relationships, 
however, can be established only by coincidence, since relay 2 cannot observe Ai(-) and relay 1 cannot 
observe A2(-)- I n a general PG, it is arguably most rational for a relay to use a replicating response as 
described in Section IIII-AI 

Definition 5: A focal equilibrium of a general pricing game is an equilibrium where every relay i 
adopts the replicating response to its local information = ((r h , (B r -(-))j &S h) h< z. Vi , (B l k (-)) k&c ,.), i.e., for 
all h G Vi, 



where (BH-), f^) heVi are as specified in Lemma 

In this section, we investigate focal equilibria in oligopolies. Such equilibria are not only reasonable for 
implementation, but also, more importantly, always efficient. The next theorem establishes the existence 
of focal equilibria in an oligopoly. 

Theorem 6: The socially optimal routing of an oligopoly is always induced by a focal equilibrium. 

"Since the derivative of is in general piecewise continuous, we henceforth allow the derivative /3f (•) of B^{-) to be piecewise 

continuous. Let /3j h (r)~ and Pi(r) + denote the left and right limits of at r. 



optimal cost. 



□ 




(r h -t), te[0,f* hl ] 
(r h -t), te{fti,r h ] 



(10) 
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Proof: Note that the equilibrium constructed in the proof of Theorem Q] is a focal equilibrium. □ 

Figure |4] illustrates a focal equilibrium in a duopoly induced by nonlinear pricing functions Bi(-), B 2 (-). 
The linear pricing equilibrium used in the proof is a special case of Figure H] such that the curves of fii(r) 
and fc{r) are the same horizontal line that passes the point where Ai(r) and \2(R S —r) intersect. Notice 
that the focal equilibria encompassed by the above example have a common property. That is, the curves 
Pi(-) and Aj(-) of all % intersect at the point that corresponds to the social optimum. The next theorem 
states that such a phenomenon is no coincidence. 

Theorem 7: Every focal equilibrium of an oligopoly is efficient. 

Proof: In light of Theorem [2l we only need to show that any monopolistic focal equilibrium is efficient. 
Let (A(')) be the pricing functions that induce such an equilibrium where m is the dominant relay. By 
the best response condition © and the fact that (3 m {-) is a replicating response to Pm(-), at = R s , 

\ m (R s ) < An(o) + = (3 m (R s )-- 

Applying © and Lemma [2] to any j m, we have 

Ai(0) > P-(Rs)- > (3 m {Rs)~. 
Therefore, X m (R s ) < Xj(0) for any j m, which implies that the monopolistic routing is efficient. □ 



To summarize, as the most reasonable outcomes of a pricing game, focal equilibria always exist and 
are always efficient in oligopolies. We have yet to find out whether these properties hold in general PGs. 
In the remainder of the paper, we focus on the class of focal equilibria when we study pricing games in 
multi-hop networkso For brevity, we will drop the qualifier "focal" henceforth. 

IV. Equilibria in General Pricing Game 

In this section, we consider a general multi-hop relay network with one source-destination pair as 
described in Section [III As in Section Unl we assume that in every local competition, a relay i declares 

PH-) = Pi(-) + dhi(-) to an he V t and all j e 5* 

Notice that if h E Vi has r h = 0, then technically any (3^ (•) is a best response since the local competition 
involving i and j E <Sf is vacuous. To prevent absurd equilibria resulting from such arbitrary pricing, 

12 We deliberately ignore the type of inefficient equilibria discussed in Section Ull-C I because there is no new discovery we can make about 
them in the general PG. They are inefficient in oligopolies, and therefore inefficient in general PGs. 
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however, we assume that i uses honest pricing P^ 1 
fan is the flow i intends to acquire from hi E Vj\h\^_ 



= d hi (t) + di(t + J2h'evt\h fti'i) wnen r h = 0- Here > 
di(t + J2h>ev t \h fh'i) 1S me derivative of the minimum 



cost incurred by i in forwarding traffic to its offsprings. Thus, ffi (t) exactly matches the actual cost of 
i for forwarding flow from h. Honest pricing, though restrictive, is in line with z's self interest. Being 
honest with its own cost, i maximally alleviates the burden of h, whose cost is partly leveraged by /3f (•). 
Therefore, honest pricing can be seen as the best effort by i to help improve the competitiveness of h, in 
the hope of earning profit from h should h later receive positive from its predecessors. 

We will frequently use the following terms. A path is a concatenation of links from s to to, while a 
sub-path is a contiguous segment of a path from a relay to w. Given a routing (/y)(tj)ef» a path/sub-path 
is said to have positive flow if f mn > for every (m, n) in that path/sub-path. Otherwise, the path/sub-path 
is said to have zero flow. The marginal cost on a path/sub-path is the sum of d mn (f mn ) over all (m,n) 
on that path/sub-path. 

Theorem 8: The socially optimal routing of a general PG can be induced by an equilibrium. 
Due to its length, the proof of the theorem is deferred to Appendix [A] 

A. Inefficient Equilibria and Price of Anarchy 

Unlike the oligopoly case, in a general PG, not all focal equilibria are efficient. The inefficiency of an 
equilibrium in general PG's is caused not only by the manipulative behavior of dominant relays but also 
by the myopia of nodes. We illustrate this point by the game depicted in Figure The derivative of link 




Fig. 6. Arbitrarily bad equilibrium of a general PG. 



cost functions are marked above each link, e.g. d gw (r) = 2M + 2e + 5{r — 2R S ), where M, e and 8 are 
positive constants such that M ^> eR s and M 3> 8R S . The pricing function of each node is marked above 
the node. There are three paths from s to w, of which (s, h, i, w) has the smallest marginal cost A8r even 

13 Node i need not use honest pricing for h! 7^ h if h! has positive incoming flow. 
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when r = R s . So the socially optimal routing should allocate R s entirely to the path (s, h, i, w). However, 
the equilibrium shown in Figure [6] leads to only s/{28) being routed on (s, h, i, w) while the rest is routed 
on (s,g,w). In fact, s is indifferent among all allocations of R s to h and g since Ph(-) = Pg{') = 2M + e. 
Figure [7] explains why such Ph(-) and (3 g {-) are h and g's best responses in their competition. Notice that 




Fig. 7. Competition between ft and g. 



h is able to win only e/(25) of the total flow because it has cost Xh{r) = d s h(r) + dh(r) = 2M + 2Sr. 
This inflated cost is a consequence of z's myopic pricing. Since i has superior cost (Aj(r) = 2Sr) relative 
to j (\j(r) = 2M + 2Sr), i can afford to match j's pricing function (3j{-) = 2M. Neither i nor j has 
any incentive to deviate from 2M since i has acquired all the flow e/(25) while making the maximum 
possible profit while j would suffer a loss if it tried to win a positive share by bidding lower than 2M. 
Although i could have made more profit if it cut its price, thereby making h more competitive, it is unable 
to discover this opportunity as it lacks "global vision". 

To conclude, although focal equilibria of a general PG rule out the manipulative pricing by a superior 
relay (cf. Sec lHI-Cl) . the equilibria are susceptible to the inefficiency caused by the dominant relays' 
myopic pricing. Such a source of inefficiency is intrinsic to networks consisting of selfish nodes who are 
aware of their neighbors only. The price of anarchy caused by myopic inefficiency can be arbitrarily large. 
For the example in Figure [6l the equilibrium holds for all large enough M and results in a total cost 

D =J 46rdr+J 2(M+e-5R s ) + 25r dr = — + 2(M + e-SR s ) \ R a - — J +5 {R, - — J , 

whereas the optimal cost is 

rRs 

D* = / A5r dr = 25Rl 



o 



Therefore, the price of anarchy is at least D E /D*, which can be made arbitrarily large by increasing M. 

Although in a multi-hop network equilibria can be arbitrarily inefficient, we will show in the following 
that there is a class of equilibria which are always efficient. 
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B. Everywhere Competitive Equilibria 

Definition 6: An equilibrium of a general PG is everywhere competitive if it induces a routing [fij)(i,j)e£ 
such that f hi > for at least two i G O h whenever r h > unless w G O h and f hw > 0^ 

Notice that the equilibrium in Figure [6] is not everywhere competitive as i is dominant to j. One would 
expect that when no relay is unrivalled, mistakes such as the one made by i could be avoided. The next 
theorem validates this intuition. Its proof is contained in the Appendix [Bj 

Theorem 9: If an equilibrium of a general PG is everywhere competitive, it must be efficient. 



So far we have assumed that s has a fixed, inelastic demand. In this section, we show that pricing games 
with an elastic source can be studied within the same framework we have developed for the inelastic case. 

We consider a source s with elastic traffic demand. The source's preference over different admitted 
rates r s is measured by a utility function U s (r s ) such that U s (r s ) = U S (R S ) for all r s > R s . In other 
words, R s is the maximum desired service rate of s. In the interval [0, R s ], U s (-) is assumed to be strictly 
increasing, concave with continuous derivative u s (-). Taking the approach of [19], we define the overflow 
rate as f sw = R s — r s . Thus, at s we have 



Let D sw (f sw ) = U S (R S ) — U s (r s ) denote the utility loss to s resulting from having a rate of f sw 
rejected from the network. Equivalently, if we imagine that the blocked flow f sw is routed on a virtual 
overflow link directly from s to w [19], then D sw (f sw ) can simply be interpreted as the cost incurred 
on the overflow link when its flow rate is f sw . Moreover, as defined, D sw (f sw ) is strictly increasing, 
continuously differentiable, and convex in f sw on [0, R s ). Denote the derivative of D sw (-) by d sw (-). Thus, 
we can treat the pricing game with an elastic source as one with an inelastic source and an overflow link 
(s,w). An oligopoly pricing game with an overflow link is illustrated in Figured! where the overflow 
link (s,w) is represented by a dashed arrow. Such an oligopoly is essentially the same as those studied 
in Section Hn] with the exception that s now has the additional option of sending traffic on link (s,w). 
From a pricing perspective, we can think of w as directly competing with relays by using a uniformly-zero 
pricing function. 

14 Recall that we have assumed in Section Hl-AI that either Oh contains at least two relays or Oh = {w}. 



V. Pricing Game with Elastic Source 




(11) 
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Fig. 8. Oligopoly with an overflow link. 

In a general pricing game, the introduction of the overflow link affects only the local competition faced 
by % E O s . Now w becomes a new competitor to all % e O s whose presence changes each i's perception 
of the competition. Specifically, the pricing function of i's virtual competitor is derived as 

B?(r) = min ]T B*(f sj ) + D sw (f sw ), 

where the minimization is taken with respect to nonnegative ((f S j)jes?, fsw) such that £\ f sj + f sw = r. 
The conclusions for pricing games with an elastic source are almost verbatim to those for inelastic pricing 
games. Limited by space, we do not elaborate further. 

VI. Conclusion 

This work presented a game-theoretic analysis of price competition in multi-hop relay networks. The 
introduction of possibly nonlinear pricing functions to the game enabled us to develop a much richer set 
of results than if we allowed only constant unit prices. While the socially optimal routing can always be 
induced by an equilibrium, the game may have inefficient equilibria as well. Furthermore, the existence 
of competition turns out to be a two-sided coin. On the one side, any competitive equilibrium in oligopoly 
pricing games and any everywhere competitive equilibrium in general pricing games must be efficient. 
On the other side, the conclusion that the price of anarchy of an oligopoly is equal to the number of 
competitors seems to suggest that more intense competition only makes inefficient (monopolistic) equilibria 
even worse. Unlike the case of oligopolies, the inefficiency of equilibria in a general pricing game can 
be attributed not only to manipulative pricing by dominant relays, but also more fundamentally, to the 
myopia of dominant relays. We showed that the price of anarchy attributed to both the monopolistic and 
myopic effects is unbounded. 
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Appendix 



A. Proof of Theorem |#| 

We prove the theorem by constructing an equilibrium that supports the socially optimal routing. Let 
be the link flows of the socially optimal routing. Denote the total incoming flow at node i by 
r * — J2hev t fhi- Note that under the socially optimal routing, a path/sub-path has positive flow only if 
it has the minimum marginal cost among all paths/sub-paths with the same origin. Let A* denote the 
minimum marginal cost of any path/sub-path from i to w (for i = w, A* = 0). Consider the following 
pricing scheme. Each relay i adopts /3f (t) = A£ for any h G V% unless r* h = 0, in which case honest 
pricing f3^(t) = d hi (t) + c£j(r* + t) is enforced. Such a pricing scheme will be referred to as marginal 
cost pricing. We show that marginal cost pricing supports the socially optimal routing. That is, for any 
relay i, given that each h G Vi has total traffic r\ to allocate^ and every relay j G adopts Pj(t) = X* h 
(if w G «Sj l , it always adopts (3^(t) = d hw (t)), (1) /3f(t) = A^ for each h G Vi is a best response and (2) 
the traffic allocation {f^heVi l% me most profitable allocation from i's perspective (cf. Lemma [U). 

We will need the following lemmas to prove the theorem. 

Lemma 3: Under marginal cost pricing, for each relay i, its virtual competitor's pricing function -B^(-) 
and its minimum outgoing cost function Dj(-) are convex. 

Lemma [3] is a special case of the next general observation. 

Lemma 4: For any K G N, the function 



is convex if every gi{-) with domain Qi is convex. 

Proof: Let y, z be two distinct points in the domain of g(-). For any A G [0, 1], let A denote 1 — A. We 
have 



K 




X^i— 1 x i — x 



mm 




i=i 




A min 




(6) 
> 



15 We consider only those h 6 Vi with r£ > 0, since any predecessor with zero traffic is irrelevant to the determination of i's best response, 
and so can be ignored. 
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( c ) 

> min _ y^g^Xi) = g(Xy + Xz). 

For equality (a), we assume (y*) = argmin E . 2/i= j / J]ifl'i(2/i) and (z*) = argmin Ei2i=2 J2i9i( z i)- Inequal- 
ity (b) follows from the convexity of each <&(•). Because Ay* + Xz* = Xy + Xz and Ay* + Xz* E ft 
for i = 1, • • • , K, we have inequality (c). □ 

Proof of Lemma \3\ By definition, 

B W) = v min t E 

2^j GS h Jhj 1 

where -B^(t) = f$ Pj( r ) dr. Under marginal cost pricing (3^{r) = A£ if j is a relay or /3j*(r) = dhj{r) if 
j is the destination, in either case Bj(t) is convex. So B^(t) is convex by Lemma 0] Similarly, we have 



Di{t) = mm £ 

which is convex also because each B\(t) is convex. □ 



Lemma [3] implies that under marginal cost pricing, (3^{t) = ^B^(t) and di(t) = ^Dj(£) are non- 
decreasing for all relays i and all h E Vi. In fact, /^(t) and c?i(t) have the following characterization. 

Lemma 5: Under marginal cost pricing, (3^{t) of any relay i and any h E Vi with positive incoming 
traffic can be expressed as^ 

\ Ki if w^S^ 

%{t) = \ h ' 1 , (12) 

I mm(d hw (i) , \%) , otherwise 

and if i has positive incoming traffic, then di(t) can be expressed as 

' x*, if w i d 

di(t) = l d iw (t), if d = W • (13) 

min (d iw (t) , A*) , otherwise 
Proof: First, by assumption, Sf contains at least one relay and every relay j in <Sf applies Pj(t) = X* h . 

If w £ , the (marginal) pricing function of i's virtual competitor is nothing but 0£{t) = A£. However, 

if w E S^ , it always adopts = d hw (t). Thus, the pricing function of i's virtual competitor is 

B~{t) = min / d hw (r) dr + X* h dr. 
1 x +v =t Jo Jo 

l6 Recall the assumption that either Oh contains at least two relays or Oh = {w}. 
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flH r h fhi) 



Because d hw (r) is increasing, (3t l (t) = j^B^{t) = min(d hw (t), X* h ). The derivation of (fT3l) is almost 
verbatim, and we we skip it for brevity. □ 

While Lemma [5] provides general expressions for (3^{t) and d^t) under marginal cost pricing, the 
following lemma specifies the values of the two functions evaluated at the optimal routing configuration, 
i.e., I3^(r* h — fa) and di(r*). These values are crucial to determining a best response (3- 1 (•) for all h G Vi. 

Lemma 6: Under marginal cost pricing and at the socially optimal routing (fmn)(m,n)es with r* = 
EmeVn f*mm n E M, we have for any relay i and any h G V it %(r* h - fa) = X* h and d^r*) = A*. 
Furthermore, = X* h for t G [r* h - fa, r* h }. 
Proof: By (fl2l> . /^(rj* - /^) can be evaluated as follows: 

X* h , XwtS? 
imn(d hw (r* h - fa), X* h ) = X* h , otherwise 
where the second equality holds since d hw (r* h - fa) > d hw (f£ w ) > X* h . So in summary, (3%{r* h - fa) = X* h 
under all circumstances. Moreover, (fT2l) also implies that P^(t) < X^ for all t G [0, rj£]. However, (5^{t) 
is nondecreasing as a result of Lemma |3j Thus, (3^{t) = A£ for t G [r^ — fhn r h\- 

Next we show that under marginal cost pricing, di(r*) = X* for all nodes i. Let's first assume r* > 
and use the expression (TT3T ). If Oi = {w}, d^t) = (3 l w {t) = d iw (t). In this case, f* w = r* and so d, t (r*) = 
diw(f*w) = K- ^ w & ®i> men a ^ tne offsprings of i announce /3j(-) = A*, thus dj(-) = A*. Finally, if 
both w and some relay j are in 0j, then di(t) = mm(d iw (t), A*). Because d iw (r*) > d iw (f* w ) > A*, we 
have rfj(r*) = min(<ij U ,(r*), A*) = A*. So we are done with the case r* > 0. 

If r* = 0, every offspring j of z adopts honest pricing = + 4/( r j + ( an( ^ ft(^) = d iw (t) 
if w G Thus, by defining = 0, we can express di(r*) as 

dAr*) = di(0) = min/3j(0) = mind i7 (0) + cL-(r-). 

If dj(r*) = X* for all j G 0;, c£i(r*) must be equal to A*. So far we have shown that dj(r*) = X* if r* > 0. 
Should r* = for some j G we can evaluate dj(r*) by <i,(r*) = <i,(0) = min fceC)j djfc(0) + d k (r* k ). If 
r£ > for all k <E Oj, then we will be able to show that dj(r*) = A*. Otherwise, we further expand those 
dk(rl) such that r£ = 0. Because the routing topology is loop-free, eventually the recursive evaluation 
will terminatejeither when all offsprings have positive incoming traffic or when the destination is the 
only offspring^). Then calculating in the reverse order of the recursive expansion, we can in the end show 

17 If w is the only offspring of a relay, say i, then r* = f* w and dj(rf) = di w (f* m ) = A*. 
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that di(r*) = X* even if r* = 0. So the proof is complete. □ 

Now we are ready to apply Lemma Q] to show that (1) using (3^(t) = A£ for all h E Vi is a best response 
of i given each h E Vi has total traffic r£ and its competitors all adopt marginal cost pricing and (2) this 
best response induces traffic allocation (f^heVi- 

Proof of Theorem \Ej[ 

Step 1: Referring to Lemma [H we first show that {fl^h&Vi maximizes 

Un ^) = E WW) - - /«) - D i*(f>*)] - D > ( E /« ) 

fee-Pi Vfte-Pj / 

= E / #( r h - *) - dt - / dt 

over all the / 4 = (J^) such that < f M < r* h for all h EVi. 

Note that if > 0, i must be on a sub-path from h to w with the minimum marginal cost, so 
K = dhi(fhi) + K- Otherwise, X* h < d h i(f^) + X*. Therefore, we can conclude that 

"fhi 



(/mW, = argmax J E / $K ~t)- d hi (t) - d^r* - f* hi + t) dt 

0<Ai<rJ \££.JQ 

hev % 

= argmax <^ ^(/^ + / d^t) dt - \ / di(r* - f^+t) dt 

0<fhi<rt Jo tZ.Jv 



0<A,<rJ ^ JO hgp 

^ argmax {fitojXO+Afo)}. 

0</ M <rJ 



The first equality follows from the fact that /3- (r£ — t) — dfti(t) — G?i(Vf — + 1) is nonincreasing in t 
(by Lemma [3]) and that 

f <0, fhi = 

PlK ~ fhi) ~ dhi(fhi) - di(r*) I ~ , (14) 

1=0, < f* hi < r* m 

which follows from Lemma [6j The second and third equalities are by regrouping terms and defining the 
terms other than f j(/^ Li) to be A (/J. We can rewrite A (/J as 

heVi Jr i~fhi 



A{f i )= / di(t)dt-E / ! ' 

JO uT^! Jr*-fT- 



Now consider the difference 



A(/J - A(/*) = / d((t) eft - E / *(*) * 
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Recall that g?;(-) is positive and nondecreasing. If f hi > for all h E Vi, then the difference is easily 
seen to be nonnegative. If f hi < fy d for all h E Vi, we can rewrite the difference as 

a(/o - A(/n = T eft - P tit) dt, 

heVi^i-fhi+fhi Jn 
which, by the same reason, is nonnegative. 

To summarize, the function A(f i ) is minimized at /* within the region F{f*) = {/j : fu > flu^h e 
Vi or //jj < fhi,yh E Vj}. Thus, it can be concluded that T^f^Li) must be maximized at f* within 
Recall that the feasible region for the maximization of f Li) is T% = {/, : < < r£, V/i G 
Pj}. Next we show that the maximizer of T^f^ Li) cannot lie in .F c (/*) = Fi\F{f*)- 

Suppose f Lj) is maximized at / i . Then at the maximum it must hold for all h E V L that 

< 0, f hi = 

I In I ~ di{fi) < 



df 



° T l (f l ;L i )=pNr* h -f hi )-d hi (f h 



hi 



= o, 
> o, 



< fhi < r* h 



f 



hi 



or equivalently 



PiK - hi) - d hl (fhi) < 



< di(ri), 
= di(fi), 



> di(ri), 



fhi = 

< hi < r* h 

fhi — r h 



(15) 



where = J2h fhi- It * s straightforward to verify that /* is a solution to the above simultaneous formulas 
(cf (fl4l) ). Next we demonstrate that there is no other solution in JF C (/*). First, if f^ = for all h E Vi or 
if /*. = r * h for all h E Vi, then F c {f*) is empty, so we are done. Otherwise, let V? = {h E Vi : = 0}, 
= {h E Vi : = r^}. Hence, for those h E Vi\(V-UVi~), is in the interior of [0, r£]. Accordingly, 
the simultaneous formulas satisfied by /* are 



hEVl 
hEVf, 
otherwise. 



(%(r* h )-d hi (0) < d,(rf), 

$( r h-fhi)-dhi(fhi) > *(r?), 
#(0) - d M (rJ) = dtfrj), 

Now suppose there is a different solution /■ in F c (f*) such that for some a,b E Vi, f' ai > f* t and 
< f* u . It follows that a $ V+ and 6 £ 7>°. Hence, /3?(r* tt - < /^-/kMmC/w)- Because 
f3l( r h-fhi)-dhi(fhi) is strictly decreasing with / w for all /i G 7^, we must have #?(r*- f' ai )-d ai (f' ai ) < 
f3\{ r t ~ fu) ~~ dbi(fbi)- However, since f' ai > 0, < r£, and they satisfy the respective formulas in (fT5l) . 
it follows that 

- f'ai) ~ dai(f'ai) > d^) > fttf - f' u ) - d bl (fL), 
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thus, a contradiction. Therefore, we have shown that no solution exists in JF C (/*). 

To recap, the maximizer of ^(/^ Li) must fall in J-(f*). Moreover, we have found that /* maximizes 
f i(f { ; Li) within JF(/*). So we can conclude that 

f* = aigmaxfitfiiLi). 

Step 2: Next we show that condition © holds with $(t) = \* h , i.e, 

B?(t)>Bt(r* h )-B?(r* h -t) 

for all h G Vi and all t G [0,r*]. Since = A£, LHS is Bf(t) = / * /3f(r) rfr = A£t. By the 

expression (fT2l) . /3?(t) < A£ under all circumstances. So the RHS of the above inequality is B^(r^) — 
- *) = fLtPH r ) dr < ASt. And this proves ©. 
Step 3: Finally, we prove that condition © is established by the combination of the pricing function 
ffi(t) = X* h and the traffic allocation f^, i.e., for all h eVi, 

BKr h d = B\{rl)-Bl{rl-r h d- 

Note that the LHS is equal to B^(f^) = jf h ' ${r) dr = X*J* hi . By Lemma H $(t) = X* h for t G 
ft - /w» r fc]- Jt follows that B iK) - B?(r* h - P hi ) = f r L r /?(r) dr = \*J* hi , So © is proved. 

L L h J hi 1 

Conclusion: With all the necessary and sufficient conditions in Lemma Q] satisfied, we can conclude 
that {t) = \* h for all h G Vi is a best response of i given that all its competitors also adopt marginal cost 
pricing. Furthermore, the socially optimal routing is the traffic allocation induced by the equilibrium 
under marginal cost pricing. Therefore, the proof for Theorem [8] is complete. □ 

B. Proof of Theorem [9] 

We use the following lemmas to prove the theorem. 

Lemma 7: Given any (focal) equilibrium with induced link flows {fu) and node total incoming rates 
(r-j), for any node i with G (0, R s ), its actual marginal cost Af(-) of forwarding traffic for any h G Vi 
(with f h >i of all other ti G Vi fixed) satisfies 

A?(/m) + < Af (/ M )-, (16) 
where \i(fhi) + and A^(/ fti ) - are the right and left limits of Af (•) at 
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Proof: First assume that i has only one offspring, which by our assumption must be the destination. 
Thus, \i(t) = d hi (t) +d iw (t). Since both d hi {-) and d iw {-) are continuous everywhere, A^(-) must also be 
continuous everywhere. The inequality (fT6l) holds with equality. 

Next assume that i has multiple offsprings. By the same reasoning as used in the proof of Lemma [21 
for any j e Oi with fj > 0, we have 

< d hi (f hi ) + piin - f l3 ) + = d hi (f hi ) +Pl(f ij )- < \i(fhi)~, 

where the equality follows from the replicating response /3 l Jt) = (3\(ri — t), t G [0, /*,•], assumed by a 
focal equilibrium. □ 

Lemma 8: Given any (focal) equilibrium with induced link flows (fhi) and node total incoming rates 
(rj), for any h w such that fhi > and fhj > for two different relays i, j 6 Oh, it holds that 

(i) the actual marginal cost A^(-), A^(-) of i and j forwarding traffic for h are continuous at fhi and 
fhj, respectively; 

(ii) the marginal pricing functions P^(-), of i and j's virtual competitors are continuous at rh — fhi 
and r h - f hj , respectively; 

(iii) 

A?(/m) = \%f h] ) = j$(r h - hi) = /f (r ft - fhj) = Vh- 
Proof: The replicating response implies f3^(f h i)~ = f3^(r h — fhi) + ■ The fact that 

f M = argmax f ${r h - r) - Af (r) dr 

0<f<r h JO 

implies (3%{r h - f hi ) + > \i{fhi)~ and \i{f h i) + > /3f (r h - f hi )-. By the same reasoning as used in the 
proof of Lemma |2l it can be shown that f3t(r h — f hi )~ > (3j(f h j)~. Invoking Lemma [7J we have 

Pi(fhi)~ = #(r fc - fu) + > A*(/w)" > \t(fk>) + > $i(T h - f hi )- > ^(f hj )~. (17) 
By symmetry, 

Pj(fhj)- = Pf(r h - f hj ) + > Aj(/ W )~ > Aj(/ W )+ > $(r fc - f h3 y > Pi(fhi)~- 

Thus, it can be concluded that all terms involved in the above two inequalities must be equal to each 
other. So the proof is complete. □ 



Lemma 9: Given any (focal) equilibrium with induced link flows {fhi) and node total incoming rates 
(rj), for any h ^ w such that f hw > and fhi > for a relay i 6 Oh, it holds that 
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(i) the actual marginal cost A^(-), A^(-) of w and i forwarding traffic for h are continuous at f hw and 
f hi , respectively; 

(ii) the marginal pricing functions flt(-) of i's virtual competitor is continuous at r h — f hi ; 
(iii) 



Proof: First of all, w always uses honest pricing, i.e., f3^(') = ^t(') = dh w {-)- So A^(-) and /3^(-) 
are continuous everywhere. For the relay i, the inequality (fT7l) holds with j being replaced by w. 
Also notice that Pi(fhi)~ < Pt(fhw) + - For otherwise, h would be able to strictly reduce its total cost 
by shifting an infinitesimal amount of flow from (h,i) to (h,w). However, since f3^(-) is continuous, 
Pt(fhw) + = (3w(fhw)~- It follows that all the inequalities in (fT7l) must hold with equality. So the proof is 
complete. □ 

Lemma 10: At an everywhere competitive equilibrium, all the paths with positive flow have equal 
marginal cost. 

Proof: Let s,ni,n 2 , ■ ■ ■ ,nk,w be the nodes on a path 1Z with positive flow at the equilibrium. For 
simplicity, denote s by n and w by n fc+1 . So f ni n i+1 > for all i = 0, 1, • • • , k. 
At the equilibrium we must have for all i — 1, • • • , k — 1, 

1 {fm-in i ) ^ d ni ini (f ni ini ) + (3 n l . +1 (f ni n i+ i) — d ni _ ini {f ni _ ini ) + Pfn+i ( r ™i — fnin i+1 ) 



We have seen inequality (a) in the proof of Lemma |7J The equality (b) follows from the replicating 
response. The inequality (c) is due to the fact that f ni n i+1 is the ideal flow rate to n i+ i given j3%£ 
Using the above relation successively from % = 1 to i = k — 1, we obtain 




sni) ^ d sril yf sril ) ~\- d nin2 yf nin2 ) -\- • • • -4' 



l n k _ 2 n k _ 1 



(n ife _ 2 n fe _ 1 ) + A^- 1 (/, 



n.k-l n k 



Finally notice that = rf nfc «;(")' so 




t n k _ 1 n k 




d 



•n k _ 1 n k 



+ d nkW (f nk 

w 



Therefore, the marginal cost of path 1Z is upper bounded as 




t n k _ 1 n k 



n k -in k 




31 

Furthermore, since the equilibrium is everywhere competitive, there exists a node m! i 7^ rij for every 
i = 1, • • • , such that / ni _ in < > 0. Using the results of Lemma [8] and [9l we can show that 

dm-imifm-mi) + A„* +1 (fnin i+1 ) — d ni _ ini (f ni _ ini ) + /^* +1 (r nj — f ni n i+ i) > A n ^ 1 (fn i - 1 n i ), 
for z = 1, • • • , — 1. Applying the above inequality successively from i = k — 1 to z = 1, we have 

— d sni {f sni ) + d nirl2 (f nin2 ) + ■ • • + d rlk _ ink ( K f nk _ ink ) + P w k (fn k w) 
^ dsniifsni) ~\~ d nin2 [fmn^) ~\~ ' ' ' ~\~ A n ^ 

> A^/sni)- 

Also by Lemma [8l A* (•) is continuous at f sni . Thus, the lower and upper bounds of the total marginal 
cost of 1Z are both equal to X^ifsm) = Vs- Since 1Z is chosen arbitrarily, we can conclude that all the 
paths with positive flow have the same marginal cost r] s . □ 

Proof of Theorem® By Lemma [TOl at an everywhere competitive equilibrium, every path with positive 
flow has the same marginal cost i] s . To prove that the routing is socially optimal, it remains to show that 
any path with zero flow has marginal cost greater than or equal to i] s . Let s,Zi,--- , z m , w be the nodes 
on a zero-flow path Z. To simplify notation, write s as z and w as z rn+1 . Recall that the flow rate of 
a path is the minimum of the flow rates on all its links. So there exist link(s) (zi,z i+ i) on Z such that 
fz iZi+1 = 0. Next we show that on path Z, 

dz i . 1 z i (fz i -iz i ) + Kl +1 (fziZ l+1 ) + > (fzi-lZi) + ') (18) 

where i = 1, ■ ■ • , m. 
Notice that for i = m, 

dz m -lZm(fzm-lZ m ) ^ Z m + 1 ( fz m Zm + l ) ^Z m -lZ m (/z m -lZ m ) "I" d ZmW (f ZmW ) > ^z m {fz m ~lZm) - 

Now consider any i — 1, • • • , m — 1. At an everywhere competitive equilibrium, if f ZiZi+1 > 0, then there 
must exist z' i+1 ^ z i+ i for which f Zi z[ +1 > 0. Applying Lemma [8] or [9l we have 

d Zi _ 1Zi (fz i - 1 z i ) + X z . +i (f ZiZi+1 ) = d Zi _ 1Zi (f Zi _ lZi ) + (3^ i+1 {r Zi — f ZiZi+1 ) > X Zi 1 (f Zi - 1 z i ) ■ 
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This is a special case of (fT8l) as A* (•) is continuous at f ZiZi+1 . If f Zi z i+1 = 0, however, we have to 
consider the following two cases. In the first case, r z . > 0, so z^ has at least two offsprings z' i+1 , z" +l 
such that f ZiZ ' i+1 > and f ZiZ n j > 0. Assume 4+i 7^ we therefore have 

d Zi _ lZi (f Zi _ lZi ) + Kl+iifziZi+i) = d Zi _ lZi (0) + A^ +i (0) + 

(a) 



> 



> d Zi _ lz M+pi(f ZiZ ' i+1 r 

i d Zi _ 1Zi (o) + %(^ - /^j > a:-(^_ 12! )+ 

Here, inequality (a) holds because f Zi z i+1 = is the ideal amount of flow to z i+ \. We applied the same 
reasoning as used in the proof of Lemma [2] to get (b). Inequality (c) follows from the replicating response 
of 2(j_|_i and from using Lemma [8] or [9] (depending on whether — w or not). Next we consider the 
case where r Zi = and consequently all offsprings of Zi adopt honest pricing to Zj. It follows that 

d Zi _ lZi {fzi- lZi ) + A 2 * +1 (/zjZj+i) = dzi- 1 z i {fzi- 1 Zi) J rf3 z l +1 (fz i Zi +1 ) — A 2 * 1 (/z 4 „ 1 zJ • 

So far we have proved (TT"8l) . Using (TT8T) we can lower bound the marginal cost of Z as 

m-l^m ) + 0^z m ui(/z 

= d ZoZl [f ZoZl ) + ■ ■ • + d Zm _ lZm [f Zrn _ lZm ) + A^ (f Zm w) 

> KAfsz^. 



If /szi > 0, by Lemma [8l A* (•) is continuous at f SZl and is equal to r] s . So we are done. If f SZl — 0, s 
must have two other offsprings z[, z" for which / S2 j > 0, / SJZ » > 0. Then we can apply the same argument 
as we used in inequalities (a) -(c) to show that 

K 1 (fsz^ + >PI [ (R s -fszO = K [ (fszO, 

where A*, (fsz[) = Vs- So we are done. 

To summarize, we have shown that at an everywhere competitive equilibrium, every path with positive 
flow has the same marginal cost r] s ; moreover, every path with zero flow has marginal cost greater than 
or equal to r] s . Therefore, the routing pattern of such an equilibrium is socially optimal. □ 
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